APPENDIX A 

Multidimensional Reed-Muller Codes 



This section derives the multidimensional (8, 4, 4) Reed-Muller codes using the set partitioning . 
techniques in cite: pietrobonl , cite: pietrobon2 . This technique does set partitioning on 
Reed-Muller code spaces instead of lattices to build code spaces. Two-level set partitioning can be 
applied to an (8,4,rfmin = 4) Reed-Muller (i.e. 11M(1,3)) code as shown in figure 
( ref: fig:codepart ) to yield subcode partition chains cite: forney3 of 

(8,4,4) 3 (8,3,4) z> (8,2,4) 3 (8,1,8) = ^Ai(0, 3). The Hamming weight of a codeword is 
denoted as wjy. At level 1 of the 2-way subgroup code partition, go is the coset leader that is added to 
(8,3,4) Reed-Muller sub-code to form an (8,4,4) Reed-Muller codeword or C (8 , 4 ,4) = C( 8) 3, 4 ) 0 atgo 
where a { € {0, 1} and go £ C (8 , 3 , 4 ) and go e C (8A4 )* Likewise the level 2, 2-way subgroup code 
partition has the form C {8 , 4 ,4) = C 9 oa) © LLo fl #' where a * G {°> md Si £ Qs,2,4) ™d 
gi e C(g,3,4) or gi e Cr 8A4 ). The level 3, 2-way subgroup code partition has the form 
C(g, 4( 4) = ©S^fligi where a,- e {0,1} and gi £ C( 8 ,i, 8 ) andg, e C( 8 , 2 ,4) org,- € C( 8>3 ,4)or 
gi e C(8 f 4,4). Each vector cj = ^^igi where; = (a 2 ,ai,ao) 8 . 



(8,4,4) 




Subgroup code partitions for (8,4,4) Reed-Muller code 
Notice that 3 levels of set partitioning yields a repetition code (8, 1,8) with rfmin = 8. It will be 
shown that a simple trellis coded, 2-dimensional (8,4,4) Reed-Muller code can yield a new code 
with rfmin > 2 x 8 = 16 or a potential coding gain of 6 dB. over a (8,4,4) Reed-Muller code. 

Table ( ref: tab:map ) shows the assignment of codewords to branch labels. The branch label 
assignment tries to preserve the conventional labeling schemes for typical modulations such as QAM 
and M-PSK. For example, for 16-QAM a pair of constellations points (0,2) and (0,4) represent a 
sequence of pairs of points that are separated further in Euclidean distance because the numerical 
difference in the points is larger (i.e. (0,4) has larger Euclidean distance than (0,2)). Likewise (0, 8) 
has large Euclidean distance than (0,4) and (0, 2). However the Euclidean distance of 16 
constellation points of an (8,4,4) Reed-Muller code space have three distinct Euclidean distances 
which are associated with the codewords having w H as shown in table ( ref: tab:map ). Therefore the 
branch labeling odes not have exactly the same meaning as for conventional modulation 
constellations. For example, the branch label difference between (1,3) or (1,4) does not reflect that 
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the Euclidean distances between these pairs of points are the same. However there is some 
significance for branch labeling when looking at pairs of constellation points that are numerically 
separated by 8 in branch labeling. Pairs (0,8) and (1,9) have dmn - 8 in Hamming distance per 
dimension. The pairs of codewords associated with the labels are also Boolean complements of each 
other. This property is important when performing set partitioning to yield constellation points with 



Binary Codeword 


Constellation Point Label 


WH 


(oooooooo) 


0 


0 


( 0 1 0 1 0 1 0 1 ) 
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4 


( 0 0 1 1 0 0 1 1 ) 


2 


4 


( 0 1 1 0 0 1 1 0 ) 


3 


4 


(00001111) 


4 


4 


( 0 1 0 1 1 0 1 0 ) 


5 


4 


( 0 0 1 1 1 1 0 0 ) 


6 


4 


( 0 1 1 0 1 0 0 1 ) 


7 


4 


( 1 1 1 1 1 1 1 1 ) 


8 


8 


( 1 0 1 0 1 0 1 0 ) 


9 


4 


( 1 1 0 0 1 1 0 0 ) 


10 


4 


( 1 0 0 1 1 0 0 1 ) 


11 


4 


( 1 1 1 1 0 0 0 0 ) 


12 


4 


( 1 0 1 0 0 1 0 1 ) 


13 


4 


( 1 1 0 0 0 0 1 1 ) 


14 


4 


( 1 0 0 1 0 1 1 0 ) 


15 


4 



caption [E] 
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Reed-Muller set of codeword "constellation" points is shown, A constellation point in Euclidean 
space is formed by transforming the binary codewords with b& = (-1 ) C| * where is a bit in a 
binary codeword c,\ Now the Euclidean distance between two codewords a, cj is defined as 
(f(cuCj) - ^ k (bijc - bjjc) 2 . Notice that the minimum Euclidean distance between codeword 
constellation points 8^ at each partition level; is denoted as 5? min therefore 
Si™ = 16 < $Un « 16 < S 2 2Mn = 16 < 5^ = 32 where partition level 0 includes all codeword 
labels (0,1, ...,15) 
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Set partitioning 




Set partitioning for ID (8,4,4) Reed-Muller code 
Table ( ref: tab:trellislDrm ) shows the set partitions for a 2-D (8,4,4) Reed-Muller code. To 
represent a 2 x (8, 4, 4) Reed-Muller code, a 2 x 4 binary matrix is formed 



y = 



[:}■ 



v 3 ,,2 ,,1 ,,0 

yi y\ y\ y\ 
y\ y\ y\ y° 



# 



A total of 2 8 = 256 points (i.e. codeword constellation points) represent the unpartitioned signal set. 
Each 2-tuple tyi,y 2 ] r has two entries that represent a branch (i.e. Reed-Muller codeword) label pair 
in table ( ref: tab:map ). Each branch label can also be represented in binary form in equation 
( ref: eq:2tuple ) where e <0, 1 > and y t = Syj + 4y? + 2yj + yf. The same mechanism for set 
partitioning cite: pietrobon2 is used for a 2 x 8-PSK example with codes and subcodes of a (2, 2, 1) 
linear block code. Therefore Co is a (2, 2, 1 ) block code and Ci , C 2 are subcodes (2, 1 , 2) and 
(2,0,oo) respectively of Co and Co => Ci r> Cz- 

This construction has similarities to the treatment of 16 QAM in cite: pietrobonl since there are 
16 (8,4,4) Reed-Muller codewords ("constellation" points). Using the same notation, the minimum 
squared subset distance (MSSD) of a partition is defined as 

Aj > mm(8Ud m ^,8l 2 d m ^,8Ud mi _ 3 ,....,5ldm 0 ) where / is the set partitioning level of a 
Reed-Muller code as shown in figure ref: figxodepart , mi is the index of binary code C m , used to 
provide the set partitioning at level /, d m , is the Hamming distance of the codewords being used to 
provide set partitioning and 8} is the Euclidean distance between constellation points at level I of the 
1-D constellation points for the Reed-Muller code. Notice that / corresponds to a bit yj in the binary 
representation of a branch label in equation ( ref: eq:2tuple ). For example, to compute the MSSD 
withrfco = Mc, = 2,dc 2 = a), then Aj > min(32J 3 ,16J2,16rfi,16rf 0 ) and for partition at level 0, 
Al > min(32rfco, 16d Co , l6d Co , 16d Co ) = min(32, 16, 16, 16) = 16. The remaining entries at all other 
partition levels are shown in table ( ref: tab:trellislDrm ). Notice that it is necessary to partition 
down to lowest levels (i.e. p = 5,6,7) to get separation between codewords in Euclidean space to 
get the benefits of trellis coding. (The 1-D codewords have a separation of A 2 = 32.) It will be 
shown that the number of encoder memory stages must be at least 3 (i.e. 8 states of memory) to get 
any benefits of this encoding. 
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[B] 



Level (p) 


Partition 


MSSD (Ap) 


Generator (r p ) r 


0 


/"i /'"i /"» \ 


min(32,16,16,16) = 


16 


[ 0 


1 ] 
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r\f /~* /~* \ 


min(32, 16, 16,32) - 


• 16 


[ 1 


1 ] 
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/"Wy"' /"^ /t /t \ 

£2(Co,Co»Co»C2j 


min(32, 16,16,oo) = 
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g~\ f /~i \ 
S2(Co,Co, Ci,C2; 


min(32;i6, 32,oo) = 


16 


[ 2 


2 ] 
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f\/ /T \ 

£2(Co,Co,C2,C2j 


min(32, 16,oo, oo) — 


16 


[ 0 


4 ] 


5 


/""V/yi /T V*"f \ 

£2(Co,Ci,C2,C2j 


min(32,32,oo,oo) = 




[ 4 


4 ] 


6 


Q(Co,C2, C2,C2) 


min(32, oo, qo.oo) = 


32 


[ 0 


8 ] 


7 


n(CnC2,C2,C2) 


min(64, 00,00,00) = 


64 


h 


8 ] 


8 


n(C2,C2,C2,C2) 


min(oo,oo,oo,oo) = 


00 





caption [E] 



memory stages must be at least 3 (i.e. 8 states of memory) to get any benefits of this encoding. For 
this example, there are more partitions with MSSD > 16 than the previous case. A trellis code 
developed with this partitioning scheme should have better distance properties for the same number 
of trellis states. 

The cosets for partitions OP can be formed as shown in cite: pietrobon2 . For example, 
£l\z°) = +z ( ¥ ) mod(16)andQ 2 (2z 1 + z°) = & + 2z l t x + z°t° where z* e {0,1}. Using entries 
in table ( ref: tab:trellislDrm ), 



Q 2 (2z l +z°) = n 2 +2z l 



0 
1 



mod(16) 



and in general a new codeword y(z) = 



y2 



Q 8 (z) in 2-space is formed as follows 



y(z) = z 1 



8 
8 



+ z K 



0 
8 



+ z" 



4 
4 



0 
4 



2 




0 


+ Z 1 


1 




0 




+ z 2 








1 


2 


2 




1 





mod(16) 



All tuples are formed as shown in equation ( ref: eq:code2D ). Note that partition Q 8 (0) is the all 
"0" codeword or "constellation" point [0,0] r . The encoding is formed using a trellis encoder for 8 

yi 



bits z*. Note also that the 8 bits in y = 



V2 



are not arbitrarily assigned to the 8 bits in z. A 



signal set mapper is used for the assignment which is discussed in detail in section ref: sectdesign 
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So for 



z=[z 7 ,z 6 ,...,z°] = [01010010] 



then 



0 


+ 


0 


+ 


1 




8 




4 




1 





1 

13 



2-tuple of codewords which correspond to y(z) 



The encoding process selects a Reed-Muller 

(oiOlOlOl) 
(lOlOOlOl) 



The encoding process is a two step process. First the information bits are mapped from IL - 1 
bits to IL bits which represent £ bits that select a particular coset of H 8 . Using the same notation as 
in cite: pietrobon2 , / is the number of information bits and L is the dimensionality of the 
multidimensional Reed-Muller code. The next step is to map the intermediate information bits to 
Reed-Muller codewords. The code rate for the new encoding process actually maps IL-l 
information bits to I L bits where / is the number of encoded bits in a Reed-Muller codeword and L 
is the dimensionality of the multidimensional Reed-Muller code. In general this yields a code of rate 
R = Jk± x JL- ^ # For the case/ = 4,/ = 8 and! = 2 theni? - Fori = 3, the code rate is 

R = JL. Notice that the overall code rate is less than the code rates for 2 or 3 successive 
Reed-Muller codewords respectively (i.e. R = 8/16 and R = 12/24). Trellis encoding is used to (1) 
introduce redundancy beyond that of the information bits of original codeword and (2) provide the 
memory necessary to construct the trellises to give additional coding gain. In order to construct 
Reed-Muller codewords for each dimension it is necessary to have 1 less information bit at the input 
to the multidimensional encoder since the trellis encoder is a rate -^-encoder where k < IL - 1. If it 
is desired to preserve an overall code rate R = 1/2 then a trellis encoder of rate can be used 
with puncturing applied to the output of the encoder to give a rate of "1". This development will 
nonetheless describe the workings of the trellis encoding using the original constructions in 
cite: pietrobon2 and then describe the performance degradations due to puncturing to preserve the 
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Level (p) 


Partition Q. p 


MSSD (A^) 


Generator (t p ) T 


0 


Q(Co,Co,Co, Co) 


min(32,16,16,16) 


= 16 
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min(32, 16, 16,32) 


= 16 
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Q(Co,Co,Ci,Ci) 


min(32, 16,32,32) 


= 16 
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4 ] 
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Q(Co,Ci,Ci,Ci) 


min(32,32,32,32) 


= 32 


[ 1 
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f2(Co,Ci,Ci,C2) 


min(32, 32, 32,oo) 


= 32 


[ 2 
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Q(Co,Ci,C2,C2) 


min(32, 32,oo,oo) 


= 32 
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4 ] 
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Q(Co,C2,C2,C2) 


min(32,co,co,oo) = 


= 32 


[ 0 


8 ] 


7 


fi(Cl,C2,C2,C2) 


min(64,oo,co,oo) = 


= 64 


[ 8 


8 ] 


8 


Q(C2,C2,C2,C2) 


min(co, 00,00,00) 


= 00 





caption [E] 



Jbacn partition is enumerated using a main* rcpieseuia 
all pairs of branch labels is a (16 x 16) matrix of 2-tuples. 
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[:] 
[:] 



[:] 

[:] 

rn 



[:] 

[;] 

[:] 



U] 

[.'.] 

[;] 



[:][:][:]-[:] 



The 2- way partition Q 1 has 128 entries and represents all 2-tuples with even or odd pairs of 
branch labels. There are 64 even pairs and 64 odd pairs of tuples. The other parti ton at level 1 is 



^ formed by adding/ 0 toQ 1 or = fl 1 + |^ ° J 



O 

ill 



5 

CO 



a 1 = 



[:] [:] [:]"[!] 
[:] ['] [:][»] 

[::] 



[':]['.']["] 
[:] [:] [:] 
[:] 



[■'.] 



[:] [:] [:]-[i] 
[?][?]['/]["] 



The 2- way partition O 2 has 64 entries and represents all 2-tuples with only even pairs of branch 



labels. The other partitions at level 2 is formed as 0 2 (z) = CI 2 + z 1 1^ j ^ -h z° ^ . 



Therefore 
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n 2 (2) = n 2 + 



[:} 



n 2 = 



Thus 0 2 (2) is a partition of all odd pairs of tuples in O 1 

[:] [:] [:]-[:] 
[|] !:i [:] : [:] 

[:][•;][';]■■[::] 



Carrying the partitioning to the next level, the 2- way partition CI 3 has 32 entries and further 
partitions branch labels which are even. The other partitions at level 3 is formed as 



Q 3 (4z 2 + 2z l + z°) = CI 3 + z 2 



[:H :H:] 



. Therefore f2 3 (4) = Q 3 -+- 



[ 



Thus £"2 3 (4) is a partition of all even pairs of tuples in Q 2 . The new matrix representation is a 
"checkerboard" pattern which is a (8 x 4) matrix 



O 3 = 



[:] [:] [:][:] 
[:] [:][!][ 

[:] [:] [:][ 
[*] [:][:][:] 

[:][;][::][::] 



14 



12 



] 



The partition at level 4 is £1 4 and has 16 elements. 
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m 



Q 4 = 



0 




0 


0 




4 



0 
8 



. 0 J [ 4 J . 8 1 [ 12 ] 

_ °J ["] _ s ] [ >- ] 
12 1 r i2 1 r 12 

. ° J L 4 J L 8 



12 
12 



Q 4 (8z 3 + 4z 2 + 2Z 1 + z°) = n 4 + z 3 



Hi] 



M 



+ z l 



+ z" 



0 

1 



Therefore 



0 4 (8) = Q 4 + Z 3 | . I • Notice that Q? = Q 4 U fi 4 (8). The remaining partitions are formed as 
follows, n 5 is a (4 x 2) matrix of elements 



0 




0 


0 




8 



and 

Q 5 (16z 4 + 8z 3 + 4z 2 + 2z 



[:][ 

mm 

1 +z°) = n 4 +z 4 j^ ° J+z 3 |^ 



0 
2 



The remaining partitions are fi 6 ,Q 7 and ft 8 which is just the all "0" codeword 



••(: 



+ z l 



0 
1 
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O 

UJ 



o 



Q 6 = 



[:][:] 
[:][:] 



and finally 



7 _ 



[[:][:]>■[:] 



Fractional Dimensional Reed-Muller Composite Codes 

This section describes how set partitioning is performed for trellis-coded fractional dimensional 
Reed-Muller composite codes. Instead of forming the L-fold Cartesian product of the same 
Reed-Muller codewords and L\ x Z, 2 x ...Lm Cartesian product is formed for a different constituent 
Reed-Muller codewords. Each constituent codeword can conceivably have a different lenght. Letting 
Ni denote the lenght of a constituent Reed-Muller code then the resulting codeword length after the 
Cartesian product is N m = ^* For example let two constituent codewords be denoted as 

Ci = C(8,4,4), C 2 = C(4,3,2). The N\ = 8,N 2 = 4. The resulting code C = C\ x C 2 has codeword 
length N m = 12. Under the previous construction, 2 (8,4,4) codes resulting in a 2-dimensional 
Reed-Muller code of length N m = 16. The effective dimension of the L —fold Cartesian product is 
L x N, Now the new code constructed composite Reed-Muller codes has a dimension that is smaller 
than the larger L —fold cartesian product form of the largest constituent code and larger than the 
L —fold cartesian of the smallest constituent code. This construction allows new codes to be 
constructed that have a richer set of code rates and weight spectra properties. For any Reed-Muller 
code denoted as Ci — C(Ni 9 Ki 9 di). The overall rate R of the a new code is thus 



R = 



# 



and the new code is denoted as 



Cm = Ci XlM.Xl* ■ - Udfree = * J 



Continuing the current example, for C\ — C(8, 4, 4), C2 = C(4, 3, 2) a new "fractional" dimension 
Reed-Muller is created which is Cm = C(12,6,<iftee = *). The resulting code has rate R = which 
is the same as the primary constitituent code with rate R = — . Furthermore the simple Reed-Muller 
constituent codes can be used for efficient encoding and decoding. Going a few steps further 
Ci = C(8,4,4),C 2 = C(4,3,2),C 3 = C(8,4,4) then C M = C(20, 10,Jfree = *). Using the same 
codes but now Ci = C(8,4,4),C 2 = C(4,3,2),C 3 = C(4,3,2) yields Cm = C(16,9, df^ = *). As 
shown a trelllis-coded, multidimensional Reed-Muller composite codes can be formed of new code 
rates, for systems that require a fixed or higher data user data rate, this construction will be used to 
meet this requirement. If it is desired to use rate 1/2 code for "heavy-coding" of a channel when the 
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constituent code is a (8,4,4) Reed-Muller code then a new code can be constructed with 
Ci = C(8,4,4),C 2 = C(4,3,2) andC M = C(12,6,<*fe = *). The resulting code has rate R = \. 
The properties of the new code are "inherited" from the parent constituent codes and the amount of 
"inheritance" can be adjusted by the set partitioning and the number of memory stages in the 
trellis-encoder. Since the code space of the smaller dimension constituent code is of smaller 
dimensionality than the largest constituent code, the set partitioning can be contrived to exploit the 
characteristics of each particular subspace. Table ( ref: tab:rmcomp2 ) shows examples of 
trellis-coded multidimensional codes C M that can be contracted from two composite Reed-Muller 
codes C(8,4,4) and C(4,3,2) for 2-fold and 3-fold cartesian products to form fractional dimensional 
composite codes. The minimum distance (d miri ) M of the composite code is formed as 
(rfmin)^ = X);=i C^min),- where (rfmin),- is the minimum distance for each composite code. The 
resulting codes have code lengths that are not simple powers of 2 nor are the resulting code rates less 
than 1/2 which is a characteristic of most Reed-Muller codes. 



Ci 


c 2 


c 3 


Cm 




Code Rate 


C(4,3,2) 


C(4,3,2) 




C(8,5,*) 


4 
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C(4,3,2) 
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6 


1/2 
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C(4,3,2) 


C(4,3,2) 


C(4,3,2) 
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C(4,3,2) 


C(8,4,4) 


C(8,4,4) 


C(20,10,*) 
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C(8,4,4) 


C(8,4,4) 
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C(24,ll,*) 
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11/24 



caption [E] 



Table ( ref: tab:rmcomp3 ) shows examples of trellis-coded multidimensional codes C M that can 
be contracted from three composite Reed-Muller codes with C(16, 5, 8) being the additional 
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caption [E] 



r — j/uiuvumug iui tuiiipuanc vuucs iuiiuws uic sums memoaoiogy as 

presented previously for new codes constructed with codes that are the same. To represent a 
composite code Cm = C(8,4,4) x C(4,3,2) Reed-Muller code, a 2 x 4 binary matrix is formed 



y = 



yi 

V2 



y\ yi y\ y°i 

_ -,2 ,,1 ,,0 

yi yi yi 



# 



whereyi represents a codeword label for C(8, 4, 4) andy 2 represents a codeword label for C(4, 3, 2). 
A total of 2 3+4 = 127 points (i.e. codeword constellation points) represent the unpartitioned signal 
set formed from the cartesian product. Each 2-tuple \y u y 2 ] T has two entries that represent a branch 
(i.e. Reed-Muller codeword) label pair in table ( ref: tab:map ). Each branch label can also be 
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represented in binary form in equation ( ref: eq:2tuple ) where y{ e {0, 1} and 
yi = 8y i + 4yf + 2y\ + y\ and yi = 4y| + 2)4 + }>2 • The same mechanism for set partitioning 
cite: pietrobon2 is used with codes and subcodes of a (2, 2, 1) linear block code. Therefore Co is a 
(2,2, 1) block code and CuCi are subcodes (2, 1,2) and (2,0, oo) respectively of C 0 and 
Co z> C\ 3 C2. However an additional subcode is introduced C 0 which facilitates the fact that the 
space spanned by yi is of smaller dimension than the space spanned by y\. 



C 0 = 



0 
0 



1 

0 



is a subcode of Co and is actually used to "supress" the fourth 



dimension of yz during set partitioning. Notice that C\ <£ C 0 but C% c C 0 which implies that the 
benefit o f partitioning 
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Multidimensional Trellis Encoder/Decoder 
Design 

This section describes the design of the trellis encoder/decoder pair for both the 
multidimensional and coset design of trellis codes. Systematic methods based on cite: calderbank2 , 
cite: turgeon are used to design the convolutional encoder/decoder pairs in general. Issues such as 
rotational invariance are covered in cite: weil , cite: wei2 , cite: wei3 and cite: pietrobon3 . A 
trellis puncturing technique similar to cite: kim is necessary for the (8,4,4) code if overall code 
rates of the new code is to be the same as the "1-D" Reed-Muller codes. A better technique based on 
composite Reed-Muller codes is the preferred approach for designing codes that provide for higher 
user data rates. 



Encoder Designs 

This section describes the design options and the design used to implement the encoder stage. 
Figure ref: fig:encoder shows the overall structure of the encoder as described in 
cite: pietrobon2 , cite: pietrobonl . The key component parts of the encoder include (1) a 
differential precoder to preserve rotational invariance of signal sets (2) a rate R = ~ convolutional 
encoder to provide redundancy in signal space (3) a multidimensional signal set mapper and (4) a 
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Reed-Muller signal set mapper. This design will also how each of these components are developed. 

Encoder System 
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Codeword 
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(8,4,4) Codewords j 



Encode System 

There are some simplifications for design step (1) due to the characteristics of rotational 
invariance related to the underlying geometrical properties of Reed-Muller codes. Design steps (2) 
and (3) will be combined using the approach in cite: calderbank2 to devise the convolutional 
encoder by first using products-of-sums expansions to precisely define the convolutional 
encoder/signal mapper. "Optimal" branch assignments to encoder states will use the approach in 
cite: turgeon . Preliminary discussions of design step (4) were described in section ref: sect:Trellis . 

The trellis encoder design will start with the set partitioning shown in table 
( ref: tab:trellislDrm_2 ). This is because by defining the convolutional encoder with rate R = k 
represents the number of partition levels below partition level Q}. The parameter k should large 
enough to select a partition with a larger MSSD than Q} . Set partitioning yields a larger MSSD 
relative to Q 1 at Q 3 in table ( ref: tab:trellislDrm_2 ) while the MSSD does not increase until Q 5 in 
table ( ref: tab:trellislDrm__2 ). Therefore k > 2 for the encoder. The next step is to determine the 
number of memory states which will be denoted as v. Since the design rules will adhere to 
Ungerboeck's design rules cite: ungerboeck , then the number of states should be at least twice the 
number of states that the encoder can transition to at each time or 2* < 2 V ~ 1 or & < v - 1, v > 3, 
There should be at least 8 encoder states. Figure ref: fig:trellisencoder shows a high level 
description of the trellis encoder. 

As a preview for the performance analysis, the maximum potential coding gain y should be 
7 = 3 dB. because the new minimum distance for the trellis code is 2d m \ n = 8 of the trellis coded, 
2-D (8,4,4) Reed-Muller code. For a rate R = 1/2 = 8/16 convolutional code with v = 3, the 
asymptotic coding gain for one of the "optimal" codes cite: lincostello is y = 1.76 dB, = 5. 
For k = 6, v = 7, the maximum potential coding gain turns out to be 6 dB. because the new 
minimum distance for the trellis code is 4d m j Tl == 16 of the 2-D, (8,4,4) Reed-Muller code. For a 
comparable "optimal" convolutional code cite: lincostello with v = 7, y = 3.98 dB, d^ = 10. 

Each state represents a set of branch labels that are ordered to reflect how the label edges are 
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assigned for each state transition. Thus state So = Q j and state S\ = fl{ + 



0 
1 



where Q} 



denotes the partition at level 1 from table ( ref: tab:trellislDrmJ2 ). (Each partition will be denoted 
as QP X to distinguish from partitions defined for table ( ref: tab:trellislDrm )). The remaining states 
have the same tuples but the tuples are ordered differently in each state. Thus Sj^S^Ss are 

composed of tuples in Q\ and SuS^Ss are composed of tuples in £l\ + 



1 



. There are 128 



branch label tuples in Q\ and since k = 2 there are 4 transitions from each state thus there are 32 
parallel transitions (i.e. branch label tuples) from each state. (Only the transitions from state Sq are 
shown for brevity.) Each transition from a state is an edge of the trellis and will be denoted as B mA 
where m is the originating state and n is the branch transition for n = 0, 1, 2, 3. Thus Z?o,o = Q\ which 
is the partition for Q\ +k . From table ( ref: tab:trellislDrm_2 ), 



0 


+ Z 1 


0 




0 






+ z° 




4 
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2 x (8,4,4) Trellis encoder 



So 

Si 

S2 
S3 
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s 5 
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Trellis Structure for v = 3 states and k ~ 2 inputs for encoder 
Figure ref: fig:2dsetpart shows the set partitions for the 2-D trellis code. To get Q? x first Q\ 9 Qj 
must be formed. Q 1 = f2(Co, Co, Co, Ci ) from table ( ref: tab:trellislDrm_2 ) is the same as Q.\ from 
table ( ref: tab:trellislDrm ). Equation ( ref: eq:omega ) shows that Q 2 * Qf . 
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Set partitioning for 2 x (8, 4, 4) Reed-Muller code, / = 0, 1 , 2, 3 
The branch labels for So then become B 0 ,o = fi?, Sou = n?(4), 5 0 ,2 = fl?(2), #0,3 = fl?(6) . 
The labeling for each Bo,n is an ordered set using additional rules described in cite: turgeon . Using 
these additional rules, the pairs of branch label tuples that are separated by maximum Euclidean 
distance are 

Once the trellis states and transition labels are defined, the convolutional encoder can be 
designed. There are two established techniques to design the convolutional encoder. Figure 
ref: figxcdesign shows the architectures for the two approaches as summarized in cite: turgeon . 
The design of the encoding stage is driven by a set of parameters needed to compute BER 
performance cite: benedetto . 

The convolutional encoders (see figure ref: fig:ccdesign ) are usually implemented as systematic 
feedback or systematic, feedforward shift register realizations with modulo-2 addition. It has been 
shown that one can convert feedback realizations to feedforward and vice versa cite: porath2 . 
Figure ref: fig:ungccencode shows the architecture of the convolutional encoders used in 
cite: pietrobonl . This is a systematic, feedback convolutional encoder with at most v(Tc + l) 
encoder tap weights that must be determined from the trellis - which is already defined. There are 
2 V (* +1 ) possible binary assignments to the tap weights and only 2* +v state and edge label 
assignments. Therefore there are many systematic, feedback encoder realizations of the trellis. Note 
that there are some assignments that won't realize the desired trellis. Ungerboeck cite: ungerboeck 
devised schemes to perform the search for systematic, feedback encoder realizations which were 
modified slightly by Costello, et al cite: pietrobon2 . The measure is goodness is determined by 
equations ( ref: eq:errorl , ref: eq:errorbit ). Two very efficient algorithms were proposed 
cite: porathl that exploit the growth of the column distance function (CDF) to allow a nested search 
instead of an exhaustive search. An even more efficient search algorithm is proposed by Costello, et 
al cite: malladi but using a systematic, feedforward encoder realization. However to get comparable 
rffree of systematic, feedback realizations requires constraint lengths that are 2v the size of the 
constraint length for feedback realizations. Another inherent drawback of these realizations is either 
feedforward or feedback is that these are linear codes which might not perform as well as nonlinear 
encoding schemes. 
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Trellis Encoder Designs 



H tTS**Ttt9rp tot hi 



1 
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Convolutional Encoder Design Architectures 

ll^rixe±Gbnvduticnal 





Sytematic Convolutional Encoder with feedback 
Figure ( ref: fig:sigmapper ) shows the signal set mapper for coded bits z = [z 7 ,z 6 , . . to 
yi,y2 where yi = (y!.yi»yi»yi] andy2 = [y^y^yLy^]- The signal mapper represents the realization 
of equation ( ref: eq:code2D ). The two 4-bit outputs yi,y2 of the signal set mapper are'then selected 
by the 2-D codeword selector to form two (8,4,4) Reed-Muller codewords. 
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2 x (8,4,4) Signal Mapper 
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2 x (8,4,4) signal set mapper with modulo-16 addition. 
The lower figure (see figure ( ref: figxcdesign )) shows the approach devised in 
cite: calderbankl , cite: calderbank2 . With this approach the signal mapping function 
x(bi,b 2 , ...,b^,b^ +1 , ...,b k ,bk+u ...,bk+ v ) is a function of all inputs and outputs of memory elements 
with bi e {+1,-1}. (This approach also does not necessarily result in a linear "encoding" step as 
does the convolutional encoding approach.) The terms b u b 2 , ...,b % are inputs that impact the 
behavior of the state machine realization of the convolutional code. These terms determine the 
number of transitions from each state where 2* is the number of transitions. The terms b M b k+v 
are the outputs of the memory elements. Letting n = k + v the signal mapping function can be ' 
expanded in a sums of products form 



x(b u b 2 , ...,b n ) = do + 5^ dtbi + e;^ diAbj + 2;;^ dijjbibjb* + ... 

+d\z...J)ib2...b„ 



# 



Equation ( ref: eq:sumprod ) can be solved for d 0 ,di,dij di, 2 ,..., n . Each product term can then be 

converted into a shift register and combinational logic realization of binary terms. The resulting 
configuration might not be as "optimal" in performance as some of Ungerboeck's approaches. When 
the output signal constellation point is an L-multidimensional, the coordinate label of a signal 
constellation point in each dimension has the form 

xk=x k {bub 2 ,...,b n ), k= 1,2,. ..,L, bi = ±1 

Set element labeling is determined by using the "signal difference" rules established in 
cite: turgeon . As a quick review, given a 1 dimensional constellation (e.g. M-AM), a signal 
difference at a particular bit position of the mapping of input bits and encoder memory stages to 
output signal levels is defined as 
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Si — U;(&i,&2, ... 9 bi-i,bi 9 ...,^jt +v ) — xQb\ y b2, ... 9 bi-i,bi, ... 9 bk+v^ I 




For 2 x (8,4,4) Reed-Muller code then 8i = (<5i l5 <5, 2 ). The definition of 5,- is also modified from 
cite: turgeon since the constellation points in E% for Reed-Muller codewords don't have the same 
distance properties relative to constellation point labels like QAM or M-PSK. For example let 
JCm(£i,&2, ...,bi-i,b~i, ...,&jfc +v ) = 0, then for 16-QAM if 



Equation ( ref: eq:sigdiffrm ) reflects that many signal labels map into the same distance thus the 
same signal differences. This redefinition should simply the ordering requirements on signal labels 
that are assigned to trellis states. Figure ( ref: fig:encoderI ) shows an encoder realization for k — 2 
inputs (i.e. &i,Z>2) that cause the transitions from each state of the trellis in figure ( ref: fig: encoder ). 
There are 3 encoder delay elements with outputs denoted as b&,bg y bio. The number of parallel 
transitions per edge transition is determined by 5 bits &2,&4, - --»&7 or 32 parallel transitions. The 
branch labels are the outputs of the mapper function Xi = xt (J? \ , bi , • - . , bi , b%* bg* b w ) , / = 1,2. Let 
each state a be defined as o^o^^g ~ <3"(4<zio + 2ag + as) where 



The branch edge labels for even number states a 0,2,4,6 are formed as follows. Let 

Bo,2a,-wj 2 = £^i(2«2 + a 1 ) where "0" is the state number and a\ 9 ai are the inputs bits that cause state 
transitions. Therefore in vector form 




,£jt + v)imod(16) < 8 
,£jfc +v )lmod(16) > 8 



# 



^i(O) 

n?(2) 
n?(6) 



# 



where Z?o,* is a vector of all transitions. The branch labels for state "2" are formed as 



b 2 ,* = n <s> 



n?(0) 
n?(2) 



Qf(4) 

n?(2) 
n?(6) 



# 



where n is a permutation matrix of the form 
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n = 



0001 
1000 
0100 

0 0 10 



and <g> is the Kronecker product since Q are sets and the goal is to permute the sets of elements. 
Likewise 

B 4t * = n 2 <g> 5 0) *,5 6) , = n 3 <g> B 0) * 
for the odd-numbered states the construction is the same which yields 



# 



B\,* = 



n?(i) 
n?(5) 

"?(3) 

n?(7) 



where 5 1,^,^ = fi?(2a 2 +ai) + 



0 
1 



and IT' is normal matrix multiplication. 



# 



Now that each state is defined by tuple a{b 10,69,6s) and each branch transition is defined by 
equations ( ref: eqrbrl - ref: eq:br5 ), equation ( ref: eq:sumprod ) can be solved for constants 
do,di,dij, ...,d\ t 2,...n for each dimensional - which is two. 

Given that all trellis branches and state transitions to and from all states are defined a FSM can 
be constructed. The FSM was realized as a large mapping table of the form shown in table 
( ref: tab:FSMtrellis ). For k = 2, inputs bits b u b 2 trigger transitions from a current state to a new 
state. Before going to a new state along the appropriate transition, one tuple is selected from the 
coset - at the current state - representing all possible edge labels using k-k bits 63,64,65. 
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Encoder Realization I (k = 2, v = 3) 
The design options have been discussed and now the particular implementation approach is 
described. Although the Ungerboeck approach used convolutional encoders to develop both linear 
and non-linear convolutional codes, the current implementation uses the non-linear approach. As for 
encoding there are two techniques. One technique is to solve for the parameters d and then for each 
input codeword to compute a branch label tuple by multiplying the corresponding row of the 
Hadamard matrix H for all possible bit combinations by d. The encoding steps are 
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1 . At time t, form row vector in equation ( ref: eq:encodehad ) of product terms with each set of 
input message bits [b u bi, ...,b k ] and memory states [b M ,b k+ 2, ...,b k+v ] of the trellis FSM. The 
sums of products expansion is shown in equation ( ref: eqrsumprod ). 

2. Perform vector-matrix multiplication in equation ( ref: eq:encodehad ) to form branch label 
2-tuple [ Xl x 2 ] 

3. Convert branch label 2-tuple to Reed-Muller binary codewords as per table ( ref: tab:map ). 

4. Modulate binary codewords to BPSK or QPSK constellation points 

5. Use FSM for trellis to compute next state at time t + 1 or 
(b k+ i,b k+ 2,...,b k+v ) t+1 = <T{(b k+ nbk+2,...,bk +v ) t ;bub 2 ,...,bk} 

6. Go to step (1). 



[ *i x 2 ] = [ 1 bi - bib 2 ...b„ ] 



do,i 
di,i 



di,2 



d(\,2,...n),\ ^(l,2,...n),2 



# 



Decoder Design 



This section describes the decoder design. Figure ( ref: fig:encoder_4_3 ) and 
( ref: fig:decoder_4_3 ) show the encoder/decoder pair for the case under investigation. The encoder 
has k = 5 input bits and 8 output bits. The 8 output bits are BPSK or QPSK modulated for each 
codeword. This particular configuration has I = 2 input bits out ofk = 5 bits used for a trellis finite 
state machine (FSM) designed with v = 3 memory cells. The non-linear mapping function uses 8 
input bits b u bi,...,bsM,bnM to generate a 2-tuple branch label for the next state from a current 
state defined by b 6 , bi,b%. The number of transitions from a current state is 2 % = 4. The number of 
branch tuples per edge transition is determined by bits b 3 ,b 4 and b 5 . There are 2 k ~ l = 8 possible 
parallel transition per edge in the trellis. For each branch label in each 2-tuple, a (4, 3) Reed-Muller 
codeword is formed for each branch label which is then translated into a BPSK or QPSK signal. The 
overall code rate is R = -f-- 
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k=Zv=3 > R=- 
8 




Encoder for 2-D (4,3) Reed-Muller code 
Figure ( ref: fig:decoder_4_3 ) shows the decoder for the 2-D (4, 3) Reed-Muller code. Input 
message bits with «,(*) = [bi(t),b 2 (t), ...,b 5 (t)] are encoded into codeword 2-tuples 
c (0 = [yi(0^2(0] where eachyi(r),y 2 (0 is a (4,3) Reed-Muller codeword. These codewords are 
modulated and transmitted over an AWGN channel with noise n(t). The Viterbi decoder receives 
channel signal r(t) and forms estimates of channel codewords c(t) and stores accompanying state 
progression information in a trellis. The inverse non-linear mapping function uses both the trellis and 
the decoded codewords c(t) to estimate the input message sequence %{t). The trellis contains a 
sequence of states and a set of transitions and codeword vectors where each state contains 
information such as 

• The transitions between states (i.e. bits b i (t), b 2 (t)) at each time epoch for the codeword 
sequence c(t). 

• The current and next states for codeword sequence c(t) (i.e. bits b 6 (t), b 7 (t), b»(t)) 
• , The address label for the 2-tuple selected for estimated codeword c(t), (i e bits 

^3(0.^4(0^5(0) 

With this information^the estimate of input message by the non-linear mapping becomes 
«/(0 = \ bi(t),b 2 {t), ...,b 5 (t)] at each time epoch in the trellis. 
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